Autonomous Design of Artificial Neural Networks

Artificial Neural Networks (ANN) have demonstrated to be increasingly more useful for complex problems difficult to solve with conventional methods. With their learning abilities, they avoid having to develop a mathematical model or acquiring the appropriate knowledge to solve a task. But the difficulty now lies in the ANN design process. A lot of choices must be made to design an ANN, and there are no available design rules to make these choices directly for a particular problem. Therefore, the design of an ANN demands a certain number of iterations, mainly guided by the expertise and the intuition of the developer. To automate the ANN design process, we have developed Neurex composed of an expert system and an ANN simulator. N e u r e x autonomously guides the iterative ANN design process. Its structure tries to reproduce the design steps done by a human expert in conceiving an ANN. As a whole, N e u r e x structure serves as a framework to implement this expertise for different learning paradigms. This article presents the system's general characteristics and its use in designing ANN using the standard backpropagation learning law.